Automatic lip contour extraction from color images
نویسندگان
چکیده
Visual information from lip shapes and movements helps improve the accuracy and robustness of a speech recognition system. In this paper, a new region-based lip contour extraction algorithm that combines the merits of the point-based model and the parametric model is presented. Our algorithm uses a 16-point lip model to describe the lip contour. Given a robust probability map of the color lip image generated by the FCMS (fuzzy clustering method incorporating shape function) algorithm, a region-based cost function that maximizes the joint probability of the lip and non-lip region can be established. Then an iterative point-driven optimization procedure has been developed to fit the lip model to the probability map. In each iteration, the adjustment of the 16 lip points is governed by three pieces of quadratic curves that constrain the points to form a physical lip shape. Experiments show that the proposed approach provides satisfactory results for 5000 unadorned lip images of over 20 individuals. A real-time lip contour extraction system has also been implemented. 2004 Pattern Recognition Society. Published by Elsevier Ltd. All rights reserved.
منابع مشابه
Automatic Segmentation of Lip Images Based on Markov Random Field
This paper addresses the problem of lip segmentation in color space that is a crucial issue to a successful lip-reading system. We present a new segmentation approach to lip contour extraction by taking account of the maximum a posterior Markov random field (MAPMRF) framework. We first examine various color models and select a simple color transform derived from LUX and 1976 CIELAB color space ...
متن کاملAutomatic Segmentation of Color Lip Images Based on Morphological Filter
This paper addresses the problem of lip segmentation in color space, which is a crucial issue to the success of a lip-reading system. We present a new segmentation approach to lip contour extraction by taking account of the color difference between lip and skin in color space. Firstly, we obtain a lip segment sample via a color transformation sequence in 1976 CIELAB and LUX color spaces. Second...
متن کاملLip Contour Extraction Based on Support Vector Machine
Lip contour extraction was a useful technique for obtaining a mouth shape in an image, and was one of the most important techniques for human-machine interface applications, such as lip reading and speech recognition. In this paper, a new method to extract lip contour from video was propose based on the fact that the lip color and skin-color was varied in the different color spaces. We first ex...
متن کاملAutomatic road extraction from aerial images by probabilistic contour tracking
In this paper a new automatic approach to road extraction from aerial images is proposed. This method improves a recently introduced promising approach to probabilistic contour tracking, originally semi-automatic, by adding a fully automatic initialization strategy and a merging methodology, able to combine the different obtained results. The initialization strategy is based on the Hough transf...
متن کاملLip contour extraction from color images using a deformable model
The use of visual information from lip movements can improve the accuracy and robustness of a speech recognition system. In this paper, a region-based lip contour extraction algorithm based on deformable model is proposed. The algorithm employs a stochastic cost function to partition a color lip image into lip and non-lip regions such that the joint probability of the two regions is maximized. ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- Pattern Recognition
دوره 37 شماره
صفحات -
تاریخ انتشار 2004